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I.  INTRODUCTION' 


An  S3-A  Viking  on  ASW  patrol  ahead  of  a  carrier  task 
group  in  the  eastern  Mediterranean  Dicks  up  a  hostile  air 
search  radar  on  its  ESM  (electronic  sensory  measures)  gear. 
This  information  is  relayed  to  the  ASW  air  control  ship 
which  in  turn  alerts  the  task  group  commander  on  the  EW 
(electronic  warfare)  net.  The  task  group  commander  orders 
the  duty  AE#  (airborne  early  warning)  aircraft  to  alter  its 
flight  pattern  to  attempt  to  get  a  visual/radar  fix  on  the 
intruder.  The  A£w  aircraft  gets  a  radar  contact  and  an  ESM 
LOB  (line  of  bearing)  that  correlates  with  the  contact. 
These  both  correlate  with  the  S3-A*s  initial  intercept.  The 
AE’.V  aircraft  enters  a  hostile  surface  symbol  into  the  ship- 
aircraft  data  link  at  the  correct  position  and  the  hostile 
is  now  on  the  scopes  of  all  NTDS  (navy  tactical  data  system) 
equipped  shios.  The  task  group  commander  now  orders  one  of 
the  SAG  (surface  action  group)  units  to  engage  the  hostile 
with  Harpoon  missiles.  Scratch  one  hostile  platform. 

This  is  the  tactical  OTH  (over  the  horizon)  targeting 
problem  solved  (under  ideal  conditions)  by  command  and  con¬ 
trol  assets  currently  available  to  the  fleet.  The  task  group 
commander,  utilizing  rapid  correlation  of  information 
derived  from  sensors  external  to  his  flagship,  evaluates  and 
prosecutes  a  hostile  platform  beyond  the  range  of  his  own 
shipboard  sensors.  The  SAG  unit  has  fired  upon*  a  hostile 
platform  its  own  sensors  have  not  detected,  Jbut  based  on  in- 
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formation  readily  available  via  its  NTDS  link  with  the  car¬ 
rier  and  the  At aircraft.  A  classic  example  of  command  and 
control  at  work. 

Command  and  control  (C2)  assets  have  frailties  too;  sus¬ 
ceptibility  to  jamming  and  to  deception#  lack  of  available 
data#  and  vulnerability  to  damage#  just  to  mention  a  few.  In 
order  to  guard  against  system  frailties  we  must  understand 
how  the  system#  or  parts  of  it#  functions  in  time  of  stress. 
If  we  can  begin  to  observe  how  the  system  functions#  we  may 
be  able  to  dec ipher  which  Darts  of  the  system  are  most  c ru- 
cial  to  the  good  performance  of  such  a  system.  This  paper 
will  attempt  to  isolate  a  oortion  of  a  C2  system  and  will 
analyze  and  attemot  to  predict  its  actions  under  various 
conditions  of  stress  through  the  use  of  gaming  and  simula¬ 
tion  techniques. 
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I  .  f.  CO  '*'* a  ip  CO^TQQL  SYSTEM 


i  c o n- a n r*  control  sysf eTi  can  c-e  viewed  as  a  large/ 
oonderous  beast  tnar  everyone  wants  to  get  hold  of/  disect/ 
.-left  oe/  catalogue/  and  ma'<  e  f  as  t  er  /  better/  and  invulner¬ 
able.  as  vet/  '■hnijon,  the  beast  has  not  oeen  caught.  The 
rr.3in  thrust  of  this  stydv  r.- i  1  1  te  directed  not  at  an  entire 
C 2  svste"/  but  nar-.er  er  one  of  its  oanv  complex  oartS/  that 
point  at  wnich  ran  an-j  mac-nine  interact  td  create  a  decision 
or  a  series  o*  oecisions  which  I  will  call  a  dec i s i on  pp i nt . 
A  decision  point  can  be  thought  o  *  as  existing  at  any  of 
various  levels  of  tre  grain  of  command.  For  example*  con¬ 
sider  the  3 1  )  (radar  intercect  officer)  in  the  back  seat  of 
an  F-]A,  a  C 1C  ( c  cob  a  t  information  center)  aboard  a  ship,  or 
a  1FCC  (tas’<  force  command  center)  aboard  an  aircraft  car¬ 


lo  facilitate  our  discussion  we  should  first  take  a 
look  at  what  tne  aenerat  sisoe  of  a  C2  system  is  and  observe 
how  some  ot  its  basic  functions  interact.  v>e  will  need  to 
acres  on  some  basic  definitions  for  this  discussion/  begin¬ 
ning  with  what  e*act!v  is  a  CP  system.  F0r  the  curpose  of 
this  study/  we  shai*  define  it  as  a  system  that  is  capable 
of  extracting  data  frcr.  the  environment/  sorting  and  analyz¬ 
ing  that  data/  and  passing  that  refined  data  (information) 
on  to  a  decision  point.  After  the  decisions  are  made /  the 
system  must  be  capable  of  oassino  that  decision  on  to  the 
appropriate  action  units  that  can  interact  with  the  environ- 


me  n  t  in  accor nance  w  i  *■  h  such  decisions. 

The  term  envi  r  o  n  m  g  n  t  ,  as  used  herein,  refers  to  the  ob¬ 
ject  world  at  large  outside  of  our  Ce*  system.  It  gives  rise 
tc  a  finite,  el tnpjin  large  and  constantly  varying,  amount 
of  data  that  is  subject  to  retrieval  by  the  system  through 
any  of  a  series  of  sensors.  Ine  environment  is  subject  to 
change  by  men  i  ou  1  at  i  or.  3  onne  by  actors.  Friendly  and  neutral 
actors  rarelv  T3<e  or  influence  an  unfavorable  chanqe.  Hos- 
tile  actors,  however,  «i  l  1  be  ettemotina  to  change  the  en¬ 
vironment  to  their  advantaoe?  which  would  mean  depriving 
friendly  sensors  of  information,  or  presenting  them  with 
false  or  conflicting  data.  Mso  to  be  addressed  later  will 
be  the  tactic  o ■  overloading  the  envi ronment  with  data  in  an 
attempt  to  000  down  a  C 2  system.  A  sensor  can  be  one  of 
various  sources  of  data,  such  as  an  intelligence  agent  in 
toe  field  or  a  P^EwS  (ballistic  vissile  Early  Warning  Sys¬ 
tem)  radar  site. 

Once  the  sensors  [-av9  gathered  data  from  the  environ¬ 
ment,  it  is  oasseo  along  the  data  links  or  other  communica” 
t i ons  means  to  a  correlation  point.  Inputs  to  a  correlation 
cnint  can  come  from  sensors  or  from  other  correlation 
points.  Here  the  available  data  and  raw  information  are  as¬ 
similated,  verified  and  reformatted  as  orocessed  information 
that  can  be  readily  used  to  aid  in  a  decision  making  pro* 
cess.  This  information  is  conveved  via  some  communications 
system  to  a  decision  noir.t.  Decisions  and  necessary  informa¬ 
tion  are  then  relayed  to  waiting  action  units.  The  environ- 


■*ent  is  then  3 !  r?r-p"  r  v  actors*  new  data  becomes  available# 
30a  the  cvcle  rereats.  r  io*Jre  II-a  o^aohicallv  snc^s  the 
system  we  have  described. 

Our  Zd  system  has  some  basic  coerat i no  characteristics 
and  limitations  that  we  should  familiarize  ourselves  vi  t  h  . 
is  is  true  of  any  system  that  deals  with  flows  and  Quanti¬ 
ties  there  '-i  information)/  this  Svsten  is  sensitive  to 
overloading/  so  our  study  should  reflect  this/  and  the  si¬ 
tuation  will  re  discussed  in  more  detail  in  Chanter  III. 
Data  flo-s  fdrouah  the  system  from  the  sensors  up#  and  at 
each  Doin':  it  funeriences  s~-e  time  delav  attributable  to 
communications  re i av  time,  correlation  checks#  human  over- 
sioht#  or  ever  -re  olo  "oiooon  hole,:  svndrome.  This  time  de¬ 
lay  reflects  ©r  tee  data's  true  worth,  since  the  less  delay 
the  information  nas  associated  wi*h  it#  the  -more  appropriate 
the  decisions  base©  on  it  are  likely  to  be.  A  classic  exam* 
de  of  this  is  four  i  in  too  oronlen  of  OTH  targeting,  where 
ioforraricn  onlv  minutes  old  mav  oe  tactically  useless. 
Another  e<a"ole  ’S  that  of  the  dMCC  (National  Military  Com¬ 
mand  Center)  oetiioo  d  e ' a  v  e  d  information  about  an  in- 
orooress  nuclear  attack#  since  the  MMCC  will  only  exist  for 
scant  minutes  durim  such  an,  attack. 

Our  Zd  system  is#  of  course#  also  vulnerable  to  physi¬ 
cal  damage-  Satellites#  oround  stations#  microwave  networks 
and  ground  cable  are  all  vulnerable  to  sabotage#  E*TP  (elec¬ 
tro  magnetic  oulse)  effects  or  vaporization  by  a  nuclear 
blast.  Elimination  of  an.  ooint  of  our  C2  system  will  begin 
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to  degrade  system  oerf ormance.  Assuming  for  the  moment  that 
system  performance  is  measured  by  some  combination  of 
time/volume  flow  of  data  measurements  then  eliminating  any 
ooint  or  link  in  our  system  obviously  degrades  it's"  perfor¬ 
mance. 

There  is  a  difference  between  the  output  of  sensors  and 
the  output  of  correlation  points  (data  vs  refined  data  or 
information);  but  if  we  accept  the  output  of  both  as  a 
time/volume  flow  of  information  to  be  refined  at  the  hex,t 
node  uo  the  chain  of  command;  then  both  should  appear  to 
benave  in  a  similar  manner  in  our  macro-system  view.  The 
model  in  Figure  ll-a»  which  has  been  basic  in  our  discussion 
of  the  overall  system  structure;  is  still  much- -too  compli¬ 
cated  to  study  in  depth  as  a  single  entity.  ,In  order  to  jus- 
tifiy  the  narrowing  down  of  our  field  of  study  of  the  sys-1 
tern.;  we  are  going  to  r.ave  to  establish  and  justify  one  new 
concept;  namely  that  a  decision  point  is  merely,  a  special¬ 
ized  or  evolved  form  of  correlation  point.  To  'this  end;  let 
us  take  a  closer  look  at  the  functions  of  the  two. 

The  function  of  a  correlation  point  is  to  take  inputs 
from  any  number  of  various  sources  and  analyze  these  inputs. 
Incuts  can  come  di  rect-1  y-  f  rom  sensors  or  t  hey  can  come  from, 
other  correlation  points.  The  evaluation  process  consists  of 
taking  information  available  and  determining  whether  °r  not 

-  r 

it  -is  consistent  with  other  information  on  the  same  subject; 
or;  if  not;  figuring  out  what  the  significance  of  the 
difference  is.  Dissimilar  portions  of  information  are  pieced 


together^  first  in  order  to  develop  the  overall  picture  of 
what  is  happening/  and  then/  after  the  initial  picturer  is 
clear/  to  keep  an  accurate  track  of  that  picture.  An  exam- 
ole  of  ’this  would  be  a  destroyer  CIC  using  its  radars  to 
detect  incoming  aircraft/  and  reporting  the  number/  altitude 
and  probable  tyoe  of  aircraft  to  the  AAW  (anti-air  warfare) 
coordinator  on  the  flagship. 

The  output  of  a  correlation  point  is  information/  usu¬ 
ally  of  -a  lesser  volume  but  in  a  more  readily  usabl e  f orm 
which  is  passed  to  another  correlation  point  or  to  a  dec i son 
point.  Thus  -the  major  act  of  a  correlation  point  is  to  pro¬ 
cess  and  summarize  large  volumes  of  information  into  ;more 
easily  used  information  and  to  reduce  raw  informational 
bulk. 

A  decision  point  functions  in  a  similar  manner.  It  re-, 
ceives  inputs  from  various  sources  and  performs  some  basi c 
functions  of  comparison  and  interpretation  of  the  informa¬ 
tion.  After  the  information  has  been  consolidated  the  deci¬ 
sion  point  demonstrates  its  difference  from  a  correlation 
point.  In  addition  to  passing  on  ref  i  bed  '.i  nf  opniati  on  /  the 
decision  point  also  utilizes  its  own  output  of  information 
to  make  one  or  more  decisions  based  on  the  situation  it  per¬ 
ceives.  The  decision  becomes  part  of  the  information  passed 
on  to  action  units  and  sensor’  units.  ' 


Sc  it  appears  to  be  a  valid  concept  that  sd nee  deci sion 
points  and  the  correlation  points  have  most  of  their 


processes  in  common  (the 'di  f  ference  be i ng  that  the  decison 


point  is  active  -  making  independent  additions  to  the  infor¬ 
mation  in  the  form  of  decisions)  they  can  in  fact  be 
analyzed  as  to  their  efficiency  in  basically  the  same  way. 
Remember  before  that  we  stated  that  a  CIC  was  a  good  examoTe 
o*  a  correlation  point.  In  conflicts  in  which  the  destroyer 
is  a  senior  participant,  it  (.the  CIC)  is  fully  capable  of 
acting  as  a  decision  point.  We  will  now  proceed  with  this 
assumotion  of  similarity  of  roles  in  mind. 

We  can  examine  our  C2  system  in  terms  of  a  series  of 
nodal  structures,  or  a  network.  The  output  (raw  information 
or  data)  from  a  series  of  sensors  flows  into  one  or  more 
correlation  points,  and  the  output  (processed  data,  or  re¬ 
fined  information)  from  a  series  of  correlation  points  flows 
into  one  or  more  decision  points.  But  now,  going  on  the 
predication  that  a  decision  point  is,  nothing  more  than  'a 

specialized  correlation  point,  and  considering  that  all 

€ 

transactions  between  entity  types  involve  compatible, 
time/volume  flows  of  information  (otherwise  extreme  conges¬ 
tion  and  delay  would  occur),  we  can  assume  that  the  struct 
ture  of  the  system  in  Figure  II-a  is  actual  1 y  composed  of 
several  smaller  nodal  pieces  simitar  to  t he  one  shown  in 
Figure  ll-b.  -  :- 

We  can  now  examine  this  smaller  piece  of'  the  system 
more  carefully.  If  we  allow  ourselves  the  luxury  o;f  decid¬ 
ing  what  the  time/volume  flew  of  information  com'ing  through 
the  communications  lines  will  be  ( i .e .  constructing  our  own 
i nput s  into  the  node  in  question)  we  can  see  that  several 
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points  worthy  of  examination  appear.  First/  does  the  commun 


ications  link  have  a  sufficient  capacity  to  ffandle  the 
volume  of  traffic/  or  will  message  traffic  tack  up  as  a 
result  of  overloading?  :>hat  occurs  when  the  flow  reaches 
the  node?  Certainly  there  is  some  time  loss  caused  by  the 
processing  delays/  but  the  important  questions  to  be  ad- 
dressed  are;  1}  what  occurs  in  the  node  itself  during  difr 
f erent  loading  levels/  these  -ranging,  from  a  lack  of  informs- 
tion  to  saturation  with  "information"/  thus  exceeding  its 
capacity  to  perform  its  correlation  function'?  2)  what  ef¬ 
fects  do  inaccurate  or  reputedly  inaccurate  information  have 
on  the  ability  of  a  oecision  point  to  function  normally 
through  all  load  levels?  .  ' 

There  are  essentially  three  things  that  can  occur  at  an 
overloaded  Point.  First/  the  information  processing  and 
stori.ng  process  can  just  get  slower  and  slower/  falling 
further  and  further  behind  the  actual  military  situation/ 
until  the  process  ei ther  grinds  to  a  halt  or  the  load  levels 
subside/  allowing  the  system  to  catch  up.  This  would  be  the 
case  with  a  relatively  inflexible  system/  foe.  example  one 
that  is  very  herdware/softw.are?' oriented*  Now.-  we  can  cons  i  der 

j  *_**■"»*  a 

making  a  human  tar  more  prominent-  in  the  system/  in:  which 
case-  two  new  possible  alternative  actions  arise*  A  ;human 
could  oot  for  processing  only  .that  inf  ormat  ion  he  deemed? 
necessary  and- s  i  an  if  i  c  ant  at  the  time,/  a  1  lowing  other  infor¬ 
mation  to  fall  by  the  si  de .  Thi.s  decision  would  prevent;  the 
system  from  bong  i  no  'down/  but  at  the  same  time/  this  selec-- 


five  scrapping  of  information  means  that  decisions  are  not 
based  on  all  available  information.  This  example  is  relevant 
to  the  TAO  (Tactical  Action  Officer)  on  a  surface  combatant 
in  an  active  threat  environment  from  submarines,  surface 
ships  and  aircraft.  His  screening  system  (CIC)  may  break 
down  partially  and  he  will  be  forced  to  do  some  gross  and 
accordingly  inefficient  screening  himself. 

The  other  human  alternative  would  be  to  sense  that  the 
system  is  getting  hopelessly  behind  and  take  the  drastic  ac¬ 
tion  of  completely  scrapping  his  automated  picture  of  the 
situation,  dumping  his  backlog,  and  restarting  his  picture 
from  scratch.  An  example  of  this  would  be  the  following: 
When  NTDS  units  are  in  a  multi-ship  link,  extraneous  infor¬ 
mation  generated  by  the  participating  units  will  sometime 
overtax  the  onboard  computer  of  one  of  the  units,  causing  it 
to  fall  behind  and  show  other  symptoms  such  as  the  refusal 
to  accept  new  inputs.  By  dropping  out  of  the  link,  purging 
the  memory  of  the  computer  and  reloading  the  program#  an 
NTDS  unit  can  come  back  into  the  link  and  rebuild  its  tacti¬ 
cal  information  in  a  total  time  of  about  ten  minutes. 

Our  model  should  consider  all  three  of  these  aspects  of 
behavior,  since  most  C2  systems  are  man-machine  types. 
Another  pertinent  item  to  be  considered  is  that  of  validity 
of  data  and  data  sources  and  the  impact  of  these  items  on 
the  ability  of  the  dec  iso  vakers  to  function.  Man  tends  to 
hedge  decisions  against  uncertainty,  so  our  model  should  be 
sensitive  to  any  real  or  perceived  inequities  in  informa- 


tional  validity. 

In  summary*  in  this  chapter  we  have  defined  the  basic 
structure  of  a  general  command  and  control  system  model* 
studied  its  functional  parts*  and  determined  that  a  general 
similarity  exists  t^t»<eeo  its  internal  functional  parts  that 
allows  us  to  examine  at;  *  of  these  parts  (a  correlation  or 
decision  point)  as  a  general  case.  This  leads  us  on  to  exam¬ 
ine  in  the  next-,  chapter  how  load  and  validity  should  affect 
this  decision/correlation  point  model*  and  to  then  proceed 
to  design  a  model  for  simulation  of  nodal  behavior  under 
conditions  that  might  be  reasonably  anticipated  to  occur 
during  a  crisis. 


III.  -A  DISCUSSION  OF  HUMAN  FACTORS 


The  correlation/decision  point  we  examined  in  Chapter  II 
can  be  thought  of  in  one  form  as  a  command  center.  In  shift¬ 
ing  attention  from  a  C2  system  analysis  to  an  analysis  of  a 
particular  node  within  the  system#  we  will  hereafter  refer 
to  the  correlation/decision  point  as  command  center.  This 
the  point  is  at  which  "it  all  happens"#  the  point  where 
available  inputs  terminate#  and  from  which  come  the  results 
of  the  decision  making  process.  Here  is  where  the  man- 
machine  interface  exists  to  aid  a  decision  maker#  and  where 
the  decision  maker  exists.  A  command  center  can  be  as  simple 
and  basic  as  a  manually  plotted  CIC#  or  as  highly  automated 
as  the  NMCC#  but  its  basic  function  remains  t„he  samet  to 
monitor  the  situation  for  which  the  command  center  is 
responsible#  and  to  attempt  to  make  correct#  timely#  deci¬ 
sions.  The  ourpose  of  this  chapter  will  be  to  examine  those 

* 

factors  that  affect-  a  command  center  under  stress  conditions 
in  order  to  develop  a  model  that  will  effectively  simulate  a 
command  center's  response  to  stress. 

A  command  center  is  subject  to  stress  in  various  forms 
that  can  adversely  effect  its  performance.  A  command  center 
can  be  overworked  or  underworked#  bc.th  of  which  impair  ef¬ 
fectiveness.  The  higher  the  level  of  irrelevant  information 
mixed  in  with  pertinent  information#  the  more  strain  is  put 
on  the  command  center's  filtering  process^  The  amount  of  in¬ 
formation  available  on  a  subject  of  interest  can  detract 
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from  efficiency  i,f  it  is  too  little  or  too  much.  A  command 
center's  normal  activities  can  be  disrupted  for  a  time  if  a 
completely  unexpected  event  of  significance  catches  it  by 
surprise  —  a  sort  of  shock  factor.  AH  these  variable  si¬ 
tuations  affect  the  command  center's  ability  to  make  timely 
and  accurate  decisions  to  various  degrees.  It  is  these  fac¬ 
tors  which  we  will  examine  in  detail.  Our  computer  model  for 
simulation  of  crisis  reflects  the  interolay  of  these  -fac¬ 
tors. 

A.  LOAD  LEVELS 

Loading  levels  or.  a  command  center  play  an  important 

part  in  examining  a  command  center's  response  to  stress.  The 

*  - 

average  person  can  assimilate  a  new  piece  of  data-,  about  a 

-  * 

situation  everv  three  minutes  with  optimum  results  for  re- 

X 

tention  and  understanding.  At  higher  rates  of  input  he  will 
tend  to  become  overloaded  with  more  information  than- he  can 

comprehend  and  use.  Consider  how  much  data  can  potentially 

_  % 

be  thrown  together  concerning  tactical  situations.  It  should 
be  apoarent  that  an  appropriate  filtering  and  condensing 
orocess  in  the  command  center  becomes  very  important  to  en¬ 
sure  that  the  decision  maker  will  not  be  inundated  With 
data.  On  the  other  hand,  if  the  command  center  becomes  un¬ 
derloaded,  its  efficiency  will  also  be  impaired.  This  is 
Derhaps  because  of  a  underutilization  data  available  and  the 
tendency  of  the  human  mind  to  wander  when  not  challenged* 

This  concept  of  load  level's  effects  is  i 1 1 ust rated 


u  r  a  n  h  i  c  a  I  I  y  in  f  i  >  j  i  /  r  r>  I  I  (  -  a  w  h  n  r  »*  w  a  iicc  a  r<  1  o  t  of  i  n  f  o  r  m  «  * 
fional  load  vnniiri  fJUl  ('jiMl  I  t  y-oifont  I  fy  index).  The  QOI  it 
o  niftfi'iurfj  n  f  r  o'rp  1  «  v  (incision  m n k  i  n a  which  is  "on  Indicant 
O  ♦  the  dnnrnn  (  n  which  the  decision  makinrj  saouenca  durino 
fit'1  o  1  o  v  i  n  o  f  of  fii»  experiment)  reflects  on  overall 

9 1  r> $  t,  § ci  1  c  effort",  it; r  can  an/*  ( r^m  the  Hours  that  the 
>  mo  cm  i*  no  of  a  '«eelsinn  r>*»wv«  of  about  10  nieces  of  informs** 
t  i  no  not  nl  avion  period  (thirty  n  lutes  in  the  referenced  ex» 
r>  e  r  i  m  e  n  t  ) .  Notice  t  a  a  t  ha vino  insufficient  information  seams 
to  have  a  morn  a  )  v  a  r  a  <7  effort  (a  a  f  a  a  r>  a  r  slope)  than  t  h  a 

o  v  o  r  I  n  a  d  e  d  s  i  *■  g  a  t  i  o  n  h  m  . 

I  h>*  droohs  in  H -lures  J  f  f  —  and  IJI-b  both  worrarif  oome 
further  discussion  o»  to  their  origin.  Ourinu  a  two  year 
period  tuto  i  no  i  no  in  I'rhrunrv  nf  1071/  a  Purdue  University 
rnonarch  team  eoniucted  a  (series  of  a  xoe  r  i  man  t  S  conceroinn 
the*  affect 'I  of  loan  and  relevance  on  decision  making.  Ihis 
work  was  dona  under  confracf  tn  the  Uffica  of  Naval  Heseerch 
(Mil?)  Coda  OhP.  I  data  used  to  dariva  the  curves  for  the 
graphs  was  taken  du  r  f  no  interactions  in  the  Tactical  and 
Negotiation}  i,»a me/  where  "individuals  fill  positions  of  n  a  ■* 
tional  decision  makers  with  reanons i h i 1 i t i es  for  the  mili¬ 
tary*  economic/  intelligence  and  negotiations  functions  of  a 

3 

nation  eno aoed  in  a  limited  war."  (he  graph*  may  tentatively 
be  considered  valid  fnp  our  intended  use  since  they  were 
taken  under  simulated  kinds  nf  military  stress  situations 
that  we  era  attempting  to  consider  in  this  study. 

The  concept  of  loading/  utilirinp  the  OtJi  graph  of  Mg- 
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ure  III -a  * 


will  be  the  first  major  item  we  will  include  in 


the  construction  of  cur  command  center  response  model* 

Since  this  loading  factor  is  subjective*  we«wi11  want  to 

generalize  the  subjects'  incuts,  rce  could  ask  whether  the 
« 

subjects  of  the  validation  are  overloaded*  underloaded*  or 

* 

ootimally  loaded*  thereby  utilizing  all  three  given  points 

% 

on  Streufert's  graoh  in  Figure  Ill-a.  However*  having  ex* 
oerienced  decision  making  orocesses  in  the  fleet*  I  feel 
that  the  extra  alternative  of  slightly  overloading  or  under¬ 
loading  should  also  ce  available.  For  this*  we  will  have  to 
interpolate  two  more  r-oints  or,  the  granh*  between  already 
existing  ooints.  Thus  our  validation  subjects  will  be 
presented  with  five  choices  of  perceived  leading  levels* 
Quantitative  values  for  these  subjective  feelings  can  be 
taken  from  the  granh.  The  load  level*  for  the  purpose  of 
this  study*  will  be  strictly  considered  to  be  whether  the 
command  center  (the  blue  or  orange  team  in  a  war-  game)  Per¬ 
ceives  it  is  overworked*  underworked*  or  working  under  on 
ontimal  load  situation,  at  'the  time  the  experimental  input  is 
reoui red. 

8.  RELEVANCY 

Information  relevan’cy  is  the  next  item  of  importance 
that  we  should  address*  and  its  importance  cannot  be'  un¬ 
derestimated.  A  considerable  amount  of-  irrelevant  material 
is  pulled  in  by  sensors  or  i s  added  on  by  incomjng  reports  * 
or  sometimes  is  even  reguired  by  outgoing  reports.'  Once 
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again#  the  command  center  filtering  process  becomes  vital  in 
protecting  the  decision  maker  from  too  much  irrelevant  in¬ 
formation  which  would  boo  down  or  delay  his  decision  making 
orocess.  Of  course  relevancy  can  be  many  things  to  many  oeo- 
ple  at  different  times.  two  decision  makers  think  or  make 
decisions  exactly  alike.  fthat  one  may  consider  important 
another  may  deem  extraneous.  A  decision  maker  may  focus  on 
one  particular  problem  for  a  period  of  time#  making  some 
valuable  information  on  another  subject  appear  irrelevant  at 
the  time  for  his  purposes,  n'e  will  have  to  be  sensitive  to 
this  conceot  when  designing  and  validating  our  response 
mode  1  . 

To  observe  how  i nf ormgt i onal  relevancy  affects  the  deci¬ 
sion  makino  process#  »e  can  examine  Figure  III-b»  a  plot  of 
percent  of  relevant  information  versus  the  SGI  for  various 
load  levels  (remembering  that  10  is  the  optimal  load),  rte 
can  observe  that  002  relevancy  is  a  significant  break  point# 
where  the  optimal  and  underload  situations  begin  to  improve 
steadily#  and  where  the  overload  situation  reaches  peak  ef¬ 
ficiency#  falling  off  thereafter.  BMle  logically  all  situa¬ 
tions  should  improve  as  relevancy  increases#  the  overload 
curve  suggests  a  possible  breakdown  in  the  filtering  process 
whereby  it  becomes  increasingly  difficult  to  sort  out  the 
relevant  materiel  when  relevancy  goes  beyond  about  00%.  - 

This  aspect  of  deci son, making  will  also  be  included  ffi 
our  command  center  response  model.  Again#  since  relevancy 
is  a  subjective  input#  we  wSnt  to  keen  the  incut's*  .general  — 


i  zed  to  orevent  too  much  di soa  r i t  y  between  subjects' 
responses.  Tne  graoh  in  Figure  III*b  is  divided  into  20%  in¬ 
crements#  so  in  order  to  avoid  any  interpolation  errors  over 
points  that  Streufert's  experiments  did  not  cover#  we  will 
allow  only  subjective  incuts  divisible  by  20.  This  will  also 
give  the  generalization  of  inputs  that  we  desire.  This  input 
will  be  combined  with  earlier  input  of  load  level  to  enter 
Figure  II-b  to  get  a  second  QQI  rating  for  the  time  the  in- 
out  is  reouested.  For  the  purposes  of  this  study#  we  will 
strictly  consider  percent  relevancy  as  that  amount  of  all 
information  being  presented  to  the  decision  maker  that  is 
relevant  to  the  task  at  hand  (localization  of  a  submarine 
contact#  reordering  a  convoy#  avoiding  detection  by  opposing 
airborne  search  assets#  or  whatever  particular  evolution  the 
decision  maker  *s  concerning  hi  iself  with  at  the  time  the 
input  is  required). 

C.  DATA  availability 

Another  important  factor  in  the  decision  making  process 
is  the  availability  of  information  (here  speaking  strictly 
of  relevant  information)  to  the  decision  maker.  Availability 
o'  information  has  a  couole  of  different  concepts  influenc- 
i  no  it.  First  there  is  the  accuracy  of  i  nf  ormat  i  on-.  The  ac¬ 
curacy#  or  supposed  accuracy  of  information#  can  have  a  sig¬ 
nificant  effect  on'  our  command  center.  When  we  discuss  ac¬ 
curacy  by  itself#  we  become  immersed  in  the  question:  how 
accurate  is  accurate  enough?  tihat  are  the  effects  of  varying 
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degrees  of  accuracy  on  the  effectiveness  of  the  command 
center?  What  haopens  if  the  information  comes  from  a  ques¬ 
tionable  source? 

How  accurate  is  accurate  enouqh?  Let’s  take  the  example 
of  OTH  targeting  of  the  Havy's  Harpoon  missile.  In  a  manual/ 
unclassified  game  of  Harooon  targeting  conducted  during  Sep¬ 
tember  1979  by  the  author/  it  was  shown  that  a  knowledge  of 
an  opponent's  position  did  not  always  guarantee  successful 
attack.  Oooonent's  course  and  speed  were  needed  for  success¬ 
ful  targeting  at  longer  ranaes.  Information  on  neutral  ship¬ 
ping  was  necessary  to  prevent  undesired  activation  of  the 
missile's  terminal  homer  on  the  wrong  ship.  These  findings 
were  consistent  with  fleet  experience  and  show  that  "some 
information",  without  regards  to  its  accuracy,  may  not  be 
sufficient  to  guide  a  successful  operation.  Accuracy  errors 
of  a  mile  or  more  can  seriously  jeopardize  OTH  targeting 
validity,  especially  since  Harooon  is  a  "fire  and  forget" 
weapon:  there  is  no  capability  to  correct  firing  data  after 
1 aunch i ng. 

Does  a  carrier  task  grouc  need  to  anticipate  attack 
within  the  next  week,  the  next  two  days,  or  the  next  four 
hours,  or  when?  The  computer  and  communications  assets 
available  to  us  today  can  give  us  a  great  deal  cf  timely, 
accurate,  data  if  that  data  is  available.  What  becomes  of  us 
if  that  data  is  not  available,  or  the  use  of  communications 
or  computers  is  denied  us  by  an  adversary?  How  well  will  we 


function  then? 


Lack  of  information  forces  the  command  center  to  extra* 
oolate  available  information  to  make  required  decisions#  and 
tends  to  cut  down  on  the  number  of  oon-reaui red  decisions 
made.  Man  is  a  conservative  animal  bv  nature#  and  will  usu- 
ally  fail  to  extract  as  much  certainty  as  possible  from 
available  data#  thereby  complicating  this  situation.  As  in¬ 
correct  data  items  enter  the  picture#  the  quality  of  deci¬ 
sions  being  made  will  be  inherently  degraded.  Extraneous  in¬ 
formation  can  likewise  interfere  with  a  decision  making  pro¬ 
cess  . 

Another  important  asoect  of  informational  accuracy  is 
the  perceived  accuracy  of  *-he  source  of  that  information. 
What  happens  if  the  source  has  Droved  to  be  unreliable  in 
the  past?  During  National  '/leek  XXIII  in  the  Mediterranean 
during  the  summer  of  1977,  the  USS  VOGE  simulated  firing 
th^ee  Harpoon  missiles  under  the  direction  of  the  USS  SARA- 
T-Q.5  .A  #  which  was  act 'no  as  SSSC  (surface  sub-surface  coordi¬ 
nator).  All  three  weaoons  were  poorly  targeted  and  were 
ruled  as  misses.  The  TAO  on  VOGE  made  an  entry  into  his  ex¬ 
ercise  log  that  since  the  SARATOGA  did  not  have  an  accurate 
oicture  of  what  was  going  on  in  the  exercise#  the  VOGE  would 
no  longer  fire  weaoons  based  solely  on  her  directions.  Look¬ 
ing  back  at  the  introduction#  we  can  see  our  smooth  and  ef¬ 
ficient  C2  system  is  being  jeopardized  by  source  reliabili¬ 
ty#  a  completely  internally  generated  problem. 

An  adversary  has  the  capability  of  influencing  the  accu¬ 
racy  of  information  we  can  gather  on  him.  He  can  distort  our 


concept  of  what  is  actually  taking  clace  by  cover  and  decep¬ 
tion  ta.ctics.  He  can  attempt  to  thwart  our  sensors  by  jam¬ 
ming  or  destroying  them/  and  do  the  same  thing  with  our  com¬ 
munications  and  oata  links.  Our  own  EMC ON  Cemmision  control) 
conditions  can  deprive  us  of  available  information.  On  the 
other  hand/  our  technological  advances  will  limit  the  abili¬ 
ty  of  the  adversary  to  jam  usi  and  our  experience  and  train¬ 
ing  can  limit  his  ability  to  deceive  us.  Physical  damage 
can  be  reduced  by  hardening  cur  systems. 

So  a  command  center  can  be  denied  information/  or  be 
given  information  that  is  actually  inaccurate  or  is  per¬ 
ceived  to  be  inaccurate.  The  decision  maker  mav/  by  over¬ 
sight  or  inexperience/  not  be  able  to  find  the  information 
he  needs.  All  this  affects  his  actual  suoDly  of  available 
information.  How  should  we  incorporate  this,  into  any  system 
model?  An  exoeriencec  operator  can  usually  gauge  how  much 
more  information  he  needs  to  be  sure*  of  a  becison.  The  accu¬ 
racy  of  his  information  may  not/  however/  linearly  affect 
his  decision  processes.  For  examine/  a  commander  can  obvi¬ 
ously  better  iudge  a  situation  if  he  has  70%  of  the  data 
than  if  he  has  35%/  but  will  his  judgement  be  twice  as  good? 
Anv  model  of  a  system  should  consider  this  and  perhaps  exam¬ 
ine  an  exponential  curve  as  well/  and  then  determine  during 
model  validation  which  reflects  reality  more  accurately. 

So  data  availability  will  be  the  third  and  last  major 
variable  that  we  will  include  in  our  response  model.  We  will 
again  measure  this  factor  es  a  subjective  response  of  a  sub- 
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ject  in  a  decision  making  role,  rfhile  we  attempted  to  gen¬ 
eralize  the  inputs  of  load  level  and  relevancy  By  providing 
a  set  of  "canned  "  resoonses  (which  we  were  in  fact  fairly 
limited  to  by  the  3UI  graohs),  with  this  response  we  will 
allow  total  freedom  between  0  and  100%.  Functional  use  of 
the  data  availability  variable  in  the  model  will  be  linear 
or  exponential  as  discussed  earlier.  For  our  study,  we  will 
strictly  define  data  availability  to  be  that  amount  of 
relevant  data  the  decision  maker  has  available  to  him  com* 
Dared  to  what  he  *eels  he  needs  to  be  completely  aware  of 
his  current  situation  (does  he  know  the  position  of  all 
enemy  units,  what  is  the  status  of  the  last  weapon  fired  at 
a  submarine,  are  nis  raoars  being  actively  jammed/  etc.). 

0.  SHOCK  FACTOR 

The  last  item  that  needs  to  be  addressed  in  our  discus¬ 
sion  of  response  to  stress  is  what  occurs  when  a  command 
center  and  its  decision  maker  are  "caught  short",  i.e.  are 
confronted  by  a  situation  that  develops  rapidly  and  for 
which  they  are  unore oared.  This  situation  must  be  met  with 
a  crisis  management  accroach  as  oooosed  to  the  normal  game 
plan,  and  invariably  culls  available  assets  away  from  their 
normal  tasks,  degrading  efficiency.  This  could  be  caused  by 
successful  deceotion  tactics  bv  the  adversary  or  a  breakdown 
in  the  intelligence  system,  as  witnessed  by  the  fall  of  the 
Shah  of  Iran. 

This  will  be  addressed  as  a  "shock  factor".  Non-ex i stent 
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under  normal  operating  conditions/  it  is  ourely  the  result 
of  total  surorise  ano  little  or  no  oreoaration/  and  will 
temporarily  degrade  the  command  center  efficiency  since  some 
normal  functions  must  be  out  aside  while  a  response  to  a 
new,  unanticipated  sitation  is  generated.  The  impact  of  such 
a  shock  factor  is  currently  undefined  and  unexplored/  but 
should  be  incoroprated  into  any  stress  related  model. 

Accordingly  we  shall  employ  our  concept  of  a  shock  fac¬ 
tor  into  our  mooel.  I*  will  act  as  a  t i me- 1 i mi  ted  degrada¬ 
tion  of  overall  efficiency.  Initial  values  will  be  10%  de¬ 
gradation  for  a  15  minute  period/  with  the  possibility  cf 
changes  durino  the  analysis  orocess.  An  event  capable  of 
bringing  on  the  "shock  factor"  will  be  defined  for  this 
study  as  one  wnich  is  unexpected  or  unprepared  for  and  that 
disrupts  the  normal  activities  of  the  command  center  (deci¬ 
sion  maker  and  nis  staff)  by  requiring  an  immediate/ 
bootstrap  response. 

E.  MODEL  INTERACTIONS  AND  CONSTRUCTION 

Having  discussed  what  I  feel  are  the  i mpor t ant  var i abl es 
to  be  included  in  our  command  center  response  model/  it  is 
now  time  to  examine  how  the  variables  should  interact. 
Since  we  are  dealing  with  subjective  inouts/  we  might  'want 
to  offer  a  choice  of  responses  that  can  be  equated  to  a 
further  subjective  input.  If  asking  the  quest-ion/  "On  a 
scale  of  1  to  10/  how  has  your  day  been?"/  you  might  expect 
to  get  a  reasonable  response  of  an  individual's  subjective 
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view  of  how  well/  or  effectively#  his  day  has  been  going. 
This  is  the  basis  for  the  final  inout  we  will  be  dealing 
with?  the  individual  decision  maker's  gut  feeling  of  how 
well  he  feels  his  command  center  is  functioning  (its  effi¬ 
ciency).  We  will  allow  the  decision  maker  the  range  of  0  to 
100%. 

We  will  Be  attempting  to  relate  the  final  input  of  the 
decision  maker ' s, est i mate  of  his  command  center's  efficiency 
to  his  previous  estimates  of  load#  relevancy  and  data  avai- 

»  v  _ 

lability  in  the  next  section.  We  want  to  have  our  model  es¬ 
timate  of  efficiency  easily  comparable  to  the  decision 
maker's  overall  estimate.  Hence#  we  need  to  nave  our  model's 
estimate  come  out  in  e  range  of  0-100%.  The'  first  step  here 
is  to  seal*?  down  the  three  major  variables  to  a  maximal  in¬ 
dividual  value  of  one  f thereby  ensuring  no  numerical  weight 
advantage  of  one  variable  over  another).  In  order  to  allow 
"us  to  compare  relative  values  among  the  three  variables#  we 
should  assign  each  variable  a  weight  factor!  where  these 
weight  factors  add  up  to  100.  This  should  allow  a  maximum 
additive  value  of  the  three  variables  multiplied  by  their* 
weioh't  factors  of  100.  The  shock  ^factor#  a  multiplicative 
variable  th-at  affects  the  whole  process#  should  be  roulti- 
olied  by  the  sum  of  the. three  major  vari abl e-inputs  (wh#n  in 
e  feet)  to  produce  a  final  model  estimate  of  efficiency. 

v  ‘  „ 

The  model  will  then  be  fed  with  all  the,  variable  ^values 
discussed  earlier  in  the  chapter#  plus  the  operational  time 
into  the  war  game  at  which  the  data  was  taken#  to  generate 


an  outout  of  game  time/  model  generated  efficiency#  and  es¬ 
timated  efficiency.  The  basic  outline  of  this  model  is  il¬ 
lustrated  in  Fio u re  IT  1  —  c  •  The  model  program  should  also  ac¬ 
cumulate  statistics  or.  average  variance  between  generated 
and  estimated  results  and  a  recard  of  individual  variances 
for  the  production  of  a  car  grapn.  This  completes  our  dis¬ 
cussion  of  the  basic  model. 

F.  TEST  ENVIRONMENT  -  WES 

The  data  will  be  collected  during  runs  of  the  wargame 
WES.  tv E S  is  a  computer  driven#  interactive#  multi-player 
wargame.  The  clavers  consist  of  two  opposing  teams  (Blue 
and  Orange)  and  an  umoire  or  exercise  supervisor.  Each  team 
has  a  graphics  disolav  and  a  status  board  to  monitor  their 
forces  and  contacts  with.  In  addition#  each  team  has  the 
ability  to  maneuver  forces#  activate  or  deactivate  sensors# 
and  to  conduct  attacks  utilizing  force  weapons  by  inputting 
orders  on  a  command  terminal.  The  game  can  be  played  with 
existing,  canned  scenarios  or  players  can  build  their  own 
scenario  databases  at  the  investment  of  tens  of  man-hours. 
By  building  a  database  the  players  can  define  the  capabili¬ 
ties  of  all  sensors#  weapons,  and  platforms#  and  can  pick 
the  starting  locations  for  the  opposing  forces.  Artificial 
intelligence  can  be  introduced  into  the  game  via  messages 
from  the  exercise  supervisor  to  concerned  sides.  Computer 
algorithms  determi ne,  the  outcome  of  sensor  detections  and 
weapons  damage  effects.  The  game  is  free  play  from  the 
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start.  Ideally  a  team  consists  of  three  to  four  ©layers. 

The  specific  scenario  used  for  cr  data  collection  will 
be  a  canned  convoy  scenario-  Blue  will  be  given  five  escort 
vessels  (with  il  assigned  a  shipboard  helicopter)  and  MPA 
(Maritime  Patrol  Aircraft)  support  to  take  a  convoy  of 
twenty-two  assorted  merchant  vessels  through  contested  wa- 
te-rs  in  a  hot  war.  Orange  forces  will  consist  of  two  subma¬ 
rines,  one  intelligence  gathering  ship,  and  tt.n  long  range 
air  reconnaissance  aircraft.  Orange's  goal  will  be  to  in¬ 
flict  as  much  damage  as  oossible  on  the  merchant  convoy, 
while  Blue's  ooal  will  be  to  maximize  the  survival  of  mer¬ 
chant  shios.  Figure  ill  — d  shows  the  di soosi t i on  of  opposing 
forces  at  game,  start,  with  Blue  forces  transiting  from  right 
to  left.  At  game  start  oooosing  -forces  have  -no  contact  with 
each  other,  with  Blue  having  only  the  intelligence  that 
Orange  forces  are  to  their  sfest .  Data  will  be  gathered  from 
the  Blue  command  center. 

G.  DATA  COLLECT  I  ON  AND  REDUCTION 

Having  constructed  our  model,  we  must  now  undertake  its 
aoDlication.  In  oroer  to  do  this  we  will  use  experimental 
data  gathered  from  a  series  of  war-games  *  us  i  ng  the  fevE  S  ((war¬ 
fare  effectiveness  simulator'  in-  the  C3  Lab  at  the  Naval 
Postgraduate  School.  Data  collection  will  be  done  in  three 
forms.  First,  throuah  the  data  collection  term  shown  in  Fig¬ 
ure  itl-e?  next  by  means  of. a  voice  recording  of  significant 
events  in  narrative  form,  and  lastly  by  t.he  use  of  close  ob- 
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FIGURE  Ill-d 


Disposition  of  Opposing  Forces  at  the  Start  of  WES  Game 


se  r vat  i  on 


The  cats  collection  icrm  is  designed  to  take  a  minimal 
amount  o"  time  a r.n  effort  to  fill  Out  during  the  actual  play 
of  the  game.  It  can  be  filled  out  by  checking  three  blocks 
and  writing  down  three  numbers.  Past  exoer i ence  -by  the  au¬ 
thor  in  collection  of  -Mata  in  fleet  exercises  has  shown  that 
the  less  comc-1  i  cat  eo  a  form  i  s«  the  more  readihy  it  will  be 
used  during  a  h  gh  concentration  effort  on  the  part  of  the 
individual  filling  it  out.  The  taoe  recorder  will  be  used 
to  note  significant  events  in  narrative  form  that  the  data 
sheet  would  net  account  for  (ss  opposed  to  a  narrative  type 
log  being  kept  uo).  This  narrative  could  point  out 
discrepancies  in  form  entries  later  during  the  analysis 
ohase#  or  could  be  user  to  confirm  that  data.  Data  collecton 
will  be  supervised  ny  the  author  in  an  effort  to  ensure  some- 
conformity  in  the  reasoning  Dehind  the  log  entries  made. 

The  objective  of  this  analysis  effort  will  be  to  corre¬ 
late  the  inouts  of  the  f*'rst  four  sections  of  the  data  fo**m 
to  the  last  sectionr  that  of  the  individual’s  perception  of 
the  efficiency  of  his  command  center..  This  will  involve  a 
quantitative  analysis  of  subjective  inputs.  -  This  self  as¬ 
sessment  could  provide  seme  misleading  data*  so  as  a  part  of 
the  analysis  we  must  examine  the  data  for  any  possibly  re¬ 
lated  inconsistencies.  The  buyout  of  the  model  will  give  us 
the  ability  to  observe  each  run  of  the  data  in  three  dif¬ 
ferent  ways,  tie  will  get  a  printout  which  wiJl  enable  us  to 
build,  a  oraoh  of  generated  versus  estimated  efficiency  dur- 


ina  each  run.  We  will  also  get-  a  orintout  of  the  average 
difference  between  the  generated  and  estimated  efficiencies 
for  each  run.  Lastly  we  will  be  able  to  construct  a  bar 
graoh  showing  in  5%  i nc recent s  the  difference  between  the 
model  generated  efficiencies  and  the  subject  estimated  ones. 

There  are  several  variables  within  the  model  that  allow 
us  to  manipulate  the  data.  The  orimary  method  of  manipula- 
t i on  will  be  in  changing  tne  respective  weights  of  the  input 
variables  of  load*  relevancy*  and  data  availabillity.  We 
can  adjust  time/weignt  factors  with  the  shock  factor.  We 
can  exolore  linear  and  exponential  effects  of  data  availa¬ 
bility.  We  cannot  expect  different  decision  makers'  results 
to  be  the  same  in  all  cases.  For  that  matter*  their  basic 
inputs  may  vary  also.  We  should  be  aware  of  a  learning 
curve,  since  data  will  be  gathered  on  consecutive  games. 
From  the  results  of  this  analysis*  *e  should  be  able  to  draw 
some  conclusions  as  to  where  the  decision-  makers  in  the  ex* 
oeriment  place  their  emchasis  when  making  decisions*  i.e. 
what  factors  of  those  we  Have  examined  are  most  critical  to 
them. 

This  chapter  has  served  to  construct  a  modal  that  will 
reflect  which  of  the  discussed  variables  (load*  relevancy 
and  data  availability)  arc  most  imoortant  to  the  decision 
makers  i r  our  experiment.  The  next  chapter  will  discuss  the 
data  collected  and  the  analysis  of  that  data  in  the  •  context 
of  .our  model  analysis. 
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IV.  ANALYSIS  OF  THE  DATA 


In  this  chaoter  we  will  analyze  the  data  gathered  from 
the  WES  game  in  three  nifferent  contexts.  We  first  want  to 
examine  the  raw  data.  During  the  examination  we  will  be 
looking  for  onv  inconsistencies  that  might  indicate  that  the 
data  is  invalid  for  intended  use*  doing  a  analysis  of 
the  variables  of  load/  relevancy  end  data  availability.  We 
will  accomplish  this  by  oraohinq  out  the  data  vs  time* 
oointina  to  any  obvious  differences  in  the  data/  and  dis- 
cussing  what  reasons  might  exolain  the  differences. 

As  you  mav  recall  from  the  last  chaoter/  we  wanted  to 
examine  two  variations  within  our  model.  Firstly/  we  wanted 
to  see  if  data  availability  had  more  of  a  linear  or  exponen¬ 
tial  effect  on  our  subject's  oerceived  command  center  effi¬ 
ciency.  vve  were  also  concerned  with  how  the  extrapolation  of 
two  extra  points  on  t^e  load  curve  might  affect  our  results. 
This  clarification  of  variations  will  be  the  focus  of  the 
second  Dcrtion  of  this  chapter.  Here  we  will  use  as  an 
analysis  tool  the  standard  deviation  between  the  model  gen¬ 
erated  efficiency  and  the  subject's  perceived  command  center 
efficiency.  fhe  basic  concept  here  is  that  the  smaller  the 
standard  deviation/  the  better  the  match  between  the 
subject's  estimate  of  his  command  center's  efficiency  and 
the  model's  generated  estimate  over  the  course  of  the  game 
(data  collection  perioo).  The  final  section  of  this  chapter 
will  deal  with  the  analysis  of  our  data/  attempting  to 
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determine  whether  there  are  a.-.  '•insistent  patterns  among 
the  variables  of  the  model  t.  a.  could  be  practically  signi¬ 
ficant.  Once  again  using  the  root  mean  squared  difference 
between  the  subject's  and  the  model's  efficiency  estimates 
as  an  analysis  tool. 

A.  EXAMINATION  OF  THE  DATA 

This  analysis  of  the  raw  data  will  be  easier  to  under¬ 
stand  if  we  first,  explain  the  sequence  of  events  that  takes 
place  in  the  WES  scenario.  The  game  can  essentially  be  bro¬ 
ken  down  into  six  definite  time  periods  or  phases.  In  Phase 
I  the  subjects  (Blue  commanders)  establish  the  rules  of  sen¬ 
sor  user  and  the  rules  of  engagement?  these  are  the  initial 
inputs.  In  Phase  II  Blue  makes  inital  contact  with  the 
Orange  forces  and  Blue  begins  the  localization  process.  In 
Phase  III  Orange  air  assets  arrive  and  Blue's  airborne  ASW 
capability  is  destroyed.  In  Phase  IV  preliminary  attacks 
are  made  by  Blue  on  Orange  submarine  units.  In  Phase  V 
Orange  Missiles  attack  Blue  surface  forces.  Phase  VI  sees 
the  destruction  of  both  Orange  submarines,  and  Blue  prepares 
for  attacks  on  the  Orange  surface  unit. 

Looking  at  Figure  IV-a»  a  plot  of  the  four  subject's 
perceived  loading  levels  throughout  the  game,  we  see  some 
baseline  disparities  that  we  might  expect  within  a  group  of 
decision  makers.  However,  there  are  three  definite  trends 
that  seemed  to  be  followed.  The  load  levels  tend  to  drop  off 
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towards  the  end  of  Pnese  I  of  the  game*  by  which  time  most 
orders  have  been  passed  out  and  as  yet  contact  with  opposing 
forces  has  not  been  maoe.  In  the  intial  contact  phase  the 
lO'd  levels  beain  to  increase  anti  remain  high  until  the  end 
of  Phase  V.  Ihere  is  so*e  tendancv  for  the  load  to  drop  down 
at  the  end  of  each  phase  of  the  battle*  then  rising  for  the 
next  series  of  encounters.  After  Phase  V  load  levels  all  re¬ 
cede  to  low  levels. 

These  results  all  tend  to  reflect  about  the  same  concept 
of  how  the  aeneral  scenario  went:  initially  load  levels  were 
high  while  hanoino  out  orders*  then  the  levels  drooped  off 
while  Blue  is  attemotino  to  obtain  data  on  activities  of  the 
oooos ing  forces.  Loan  levels  increased  again  after  contact* 
ana  remained  fairly  High  during  the  process  of  localization 
and  destruction  of  the  opposing  force.  After  the  opposing 
force  was  neutralized*  the  load  levels  went  back  down. 

faovino  on,  let's  look  at  Figure  IV-b*  a  plot.  of  the 
subject's  perceived  informational  relevancy  vs,  time.  Note 
that  relevancy  was  never  perceived  to  be  less  than  60%. 
Relevancy  seems  to  have  taken  two  tracks.  One  track  tends  to 
remain  at  or  near  100%  throughout  the  course  of  the  game. 
Ihe  other  track  starts  at  a  lower  level  and  reflects  a 
further  Icwerina  durina  Phases  I T  —  V  *  those  where  contacts 
and  combat  are  occurring.  The  high  degree  of  relevancy  re¬ 
flected  throughout  could  be  explained  by  the  data  environ¬ 
ment.  In  the  computer  driven  wargame*  not  much  data  exists 
that  is  irrelevant  to  the  overall  game.  The  alternate  track 
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of  lower 


rel evancv 


could  have  been  caused  by  a  decision 


maker's  concentrating  his  cental  efforts  on  a  small  oortion 
of  the  tactical  situation  but  still  being  exoosed  to  infor¬ 
mation  concernino  the  overall  situation. 

Now  let's  examine  Figure  IV-c*  a  plot  of  perceived  data 
availability  vs .  time.  In  this  clot  we  see  three  fairly 
consistent  sets  of  data  anti  one  set  whose  baseline  is  far 
lower  than  the  others.  This  lower  baseline  plot  shows  an  ex- 
agaerated  increase  as  time  goes  on  --  an  increase  that  is 
minimal  in  the  other  three  sets  of  data.  This  lower  set  of 
data  will  have  to  oe  considered  when  examining  the  data  out- 
out  of  the  model  in  the  last  section  of  this  chapter*  since 
it  is  so  low  that  it  may  not  be  totally  explainable  as  a 
difference  in  decision  makino  styles. 

Lastly*  we  should  look  at  figure  lV-d»  a  plot  of  per¬ 
ceived  command  center  efficiency  vs .  time.  Note  again  that 
there  is  one  low  baseline  olot  at  the  beginnia  (not  from  the 
same  data  set  as  the  low  oaseline  olot  referred  to  in  the 
last  naragraoh).  The  overall  general  trend  of  the  graph  is 
that  the  command  center  efficiency  is  degraded  during  con¬ 
tact  and  combat*  and  that  as  combats  are  resolved*  the  effi¬ 
ciency  rises.  It  is  oossible  that  the  low  baseline  plot  may 
be  traced  to  the  subject's  feeling  that  the  initial  distri¬ 
bution  cf  orders  and  rules  of  engagement  involved  too  much 
effort  and  detracted  from  the  command  center's  ability  to 
function.  This  low  baseline  should  be  kept  in  mind  as  we  ex¬ 
plore  the  results  of  the  model  analysis  in  the  last  section 
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of  this  chao  ter  though. 

6.  MODEL  VARIATIONS 

The  data  were  run  throuoh  four  versions  of  our  mcoel. 
The  first  version  of  the  node  1  was  as  discussed  in  the  last 
chanter  (linear  data  availability  function).  The  second  ver* 
s  i  on  was-  different  in  that  the  data  availability  function 
was  exponent i a  1  instead  of  linear,  that  is  to  say  that  hav* 
i ng  50%  data  availability  created  in  the  model  an  effective* 
ness  value  of  75%,  and  sc  on  down  an  exponential  curve.  * 
thipo  version  of  t^g  model  consisted  of  entering  the 
relevancy  qraoh,  grouping  the  high  end  very  high  responses 
together  instead  of  arguoing  the  ootimum,  high  and  low 
responses  together.  The  lest  version  consisted  of  a  combina¬ 
tion  of  the  second  and  third  versions.  The  reason  these  ver¬ 
sions  were  out  together  was  to  attemot  a  sensitivity 
analysis  of  these  versions  in  an  effort  to  determine  which 
version  was  actually  closer  to  how  the  subjects  functioned. 

In  order  to  determine  which  version  of  the  model,  if 
any,  was  consistently  closer  to  the  way  the  subjects  func¬ 
tioned,  «e  need  to  establish  some  measure  of  fit  between,  the 
model  generated  efficiencies  and  the  subject's  estimates. 
For  this  ourpose  I  choose  to  take  the  standard  deviation- 
between  the  subject's  estimates  and  the  model  generated  ef¬ 
ficiencies  for  the  duration  of  each  game.  Since  I  was  doibg 
a  factor  analysis  which  required  56  runs  of  the  data  through 
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the  node*  per  aata  set/  I  could  then  construct  a  graph  of 
increasing  start  lard  deviations  for  each  data  set  run  through 
each  version  of  t he  model.  I  ranked  each  group  of  36  runs 
fro^  lowest  to  hiohest  standard  deviation  anc  graohed  then. 

figure  IV— e  graphically  Portrays  the  most  obvious 
difference  of  the  four  sets  of  data  when  run  through  each 
<r.oael.  The  curves  of  the  linear  and  exponential  data  availa¬ 
bility  functions  have  considerably  lower  standard  deviations 
t^an  the  curves  represent i no  the  involvement  of  the  inter¬ 
polated  high  load  and  1  o-.-  load  functions  that  are  used  to 
enter  the  relevancy  graph  of  Figure  IH-b.  You  recall  that 
we  added  two  extra  points  to  the  graph  in  Figure  III -a. 
Since  there  were  no  corresoonding  lines  of  information  in 
Figure  111-0/  it  was  necessary  to  see  whether  utilizing  the 
hioher  valued  entry  lines  or  the  lowe'1  value  entry  lines  was 
more  in  line  with  reality  after  observing  the  results  of  the 
experiment.  This  signifies  that/  for  one  set  of  data/  the 
first  or  second  versions  of  the  model  are  most  nearly  in 
line  with  the  subject's  responses.  The  other  sets  of  data 
showed  this  same  trend/  only  to  a  lesser  degree* 

8y  doina  this  sensitivity  analysis  on  the  model/  driving 
the  standard  deviation  down  by  examining  the  effects  of 
changing  some  inner  functions  of  the  model/  we  can  now  say 
that  the  results  that  we  are  interested  in  should  probably 
come  from  one  of  the  first  two  versions  of  the  model.  The 
next  section  of  this  chapter  will  deal  with  what  the  data 
may  show  us  about  the  decision  makers  in  our  experiment. 
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FIGURE  IV-e 


c 


MODEL  RESULTS 


Having  Hat  er  mi  neo  that  two  of  the  versions  of  the  model 
may  apply  to  the  results  of  the  model  runs*  we  now  want  to 
see  exactly  what  information  we  could  derive  from  the  those 
results.  The  orocess  of  analysis  will  be  to  first  ord^r 
each  data  set  r^r.  by  standard  deviation,  A'e  will  olot  the 
results  again,  but  tMs  time  we  will  plot  the  relative 
weights  assignee  eacr  criT^ry  variable  of  the  model  (load, 
relevancy#  an  f  data  availability)  vs.  the  order  of  toe  run 
by  standard  deviation.  .mat  we  would  hope  to  find  in  our 
graphs  is  a  common  factor  that  will  tell  us  something  about 
the  subject’s  perception  of  behavior  in  the  environment  in 
which  the  data  was  taken. 

Figure  iV-f  is  characteristic  of  the  appearance  of  al! 
these  graphs.  see  load  leva'  havioa  the  heaviest  weight 
at  the  lowest  standard  deviation#  with  relevancy  and  oat a 
availability  at  the  lowest  point.  &s  we  move  back  in  the 
order#  w?  see  that  the  weight  of  the  load  factor  decreases 
as  the  relevancy  factor  increases#  the  data  availability 
remaining  constantly  low-  This  interaction  was  common  for 
all  plots  in  that  the  data  availability  always  started  at 
the  lowest  point  and  moved  up  slowly  as  load  and  relevancy 
interacted.  Load  and  relevancy  were  almost  equally  divided 
as  the  important  factor  (highest  -weight)  of  all  the  runs. 
That  would  lead  us  to  the  conclusion,  that  the  amount  of  -date 
availability  is  of  the  least  concern  to  the  subjects  tested. 


Relevancy 
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Noting  also  that  t re  cest  correlation  was  accrued  (smallest 
standard  deviation)  when  load  was  weighted  heaviest#  we  can 
draw  the  conclusion  that  the  subject's  assessment  was  almost 
entirely  driven  by  His  loadino. 

But  is  this  conclusion  valid  in  a  broader  sense#  or  have 
the  results  neen  biased  in  some  fesnion?  The  tact  that  the 
data  availability  variable  comes  out  ac  being  least  impor¬ 
tant  of  our  three  major  variables  leads  us  to  re-examine  the 
data  taking  env  i  ron^ent  #  namely  the  WES  game.  A  closer  look 
at  the  lab  environment  and  the  game  indicates  that  there  is 
considerably  more  data  available  to  the  decison  maker  than 
woulo  be  expected  in  a  real  command  center  in  tactical 
ooerations#  and  the  dose  proximity  of  the  data  physically 
to  the  decision  maker  tends  to  further  exaggerate  this  avai- 
labilitv.  This  generous  data  availability  was  properly 
spotlighted  by  tn?  model#  so  we  can  make  some  statement  to 
the  effect  that  the  model  did  at  least  function  well  enough 
to  pick  uo  the  correct  weiahtinq  factor  of  the  data  availa¬ 
bility  In  our  analysis. 

Prom  the  analysis  of  the  data  we  have  been  able  to  ac¬ 
complish  three  things,  we  have  conducted  a  sensitivity 
analysis  to  deter  doe  how  to  adjust  model  functions  to  op¬ 
timally  reflect  the  subject's  self  assessments  of  the  com¬ 
mand  center  situation.  We  have  then  been  able  to  determine# 
within  the  test  environment#  which  variables  in  the  model 
were  most  crucial  end  least  crucial  to  the  decision  making 
processes  of  our  test  suojects.  Perhaps  more  importantly#*  we 


have  seen  the  need  f  or  a  new  source  of  test  data  to  further 
■investigate  the  area  of  hu«ian  factors  via  factor  analysis? 
recoonizino  thaf  we  can  ^a^e  no  broad  statements  based  on 
the  data  and  source  we  used  in  this  study.  The  concent  of 
the  shock  factor/  whicn  we  also  wanted  to  investigate/  re* 
ceived  insufficient  c  -  for  any  analysis. 


V.  SiUDf  RESULTS  AND  COMMENTS 


In  closing  this  study  of  human  factors  in  a  command 
center  environment/  I  think  it  is  essential  that  we  discuss 
three  major  areas  that  have  influenced  the  initiation*  pro¬ 
gress*  and  results  of  tne  studv.  We  want  to  first  discuss 
some  of  the  problems  of  dealing  with  a  topic  of  human 
behavior.  Next  we  examine  the  testbed  from  which  the  data 
came*  especially  since  that  testbed  is  newly  installed  at 
the  Naval  Postgraduate  School.  Lastly  we  discuss  the  motiva¬ 
tion  for  the  project  and  whether  it  lived  up  to  expecta¬ 
tions. 

A.  PITFALLS  OF  HUMAf:  FACTORS  RESEARCH 

Any  research  done  involving  human  factors  is  susceptible 
to  some  potential  pitfalls  that  need  to  be  planned  around  or 
comoensat  ed  for.  r;nen  you  take  data  from  a  group  of  indivi¬ 
duals*  you  must  be  sure  that  they  are  as  homogeneous  or 
heterogeneous  as  is  required  by  the  research  you  are  at¬ 
tempting  to  do.  In  the  case  of  this  thesis  I  required  a 
homogeneous  group  of  field  experienced  military  officers.  My 
subjects  in  this  case  were  all  0 - 3 1  s  with  4-6  years  of  field 
experience  in  operational  billets.  Since  the  Participants 
were  making  decisions  in  a  wargaming  environment*  the  fact 
that  decision  makers  all  exhibit  different  mental  processes 
in  accordance  with  their  personal  traits  and  experience  was 
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considered  when  the  data  was  evaluated  and  analyzed.  The 
environment  in  which  any  data  is  gathered  can  have  a  defin¬ 
ite  influence  on  that  data.  The  environment  for  the  data  is 
discussed  in  detai i  in  the  next  section  on  WES  as  a  data 
source . 

There  are  two  more  important  oitfalls  which  may  have  ad¬ 
versely  affected  this  study.  The  first  is  the  utilization  of 
self-assessment  as  a  oort ion  of  the  data  collection.  It  is 
possible  that  this  could  generate  some  dangerously  mislead¬ 
ing  data  for  i na i v i oua 1 s .  In  order  to  facilitate  detection 
of  this  problem  ana  in  an  effort  to  minimize  any  potential 
effects  it  mignt  have/  I  employed  the  assessments  of  several 
individuals  in  the  test  came  instead  of  any  single  individu¬ 
al.  3v  graphing  out  the  raw  oata  I  could  look  for  any  incon¬ 
sistencies  wnicn  would  indicate  that  the  self-assessment  was 
a  problem  in  the  data  (this  problem  did  not  appear).  The 
otner  pitfall  is  that  of  attempting  to  utilize  totally  sub¬ 
jective  responses  from  participants/  comparing  one  set  of 
personal  evaluations  with  an  overall  personal  evaluation  to 
achieve  quantitative  results.  Tor  confidence  in  the  results/ 
a  careful  selection  of  objective  quantitative  measures 
should  be  sought/  to  correlate  objective  data  with  subjec¬ 
tive  evaluation.  For  example/  data  relevancy  could  be  ob¬ 
tained  by  counting  the  data  provided  to  the  subject  as  ei¬ 


ther  relevant  or  irrelevant 


R.  WES  AS  A  DATA  SOURCE 

The  exoeriment al  data  was  taken  from  participants  play- 
ino  a  convov  scenario  using  the  wES  orogram  at  the  C3  Lab  at 
the  f,javal  Postgraduate  School.  The  data  gathered  here  is 
suoject  to  possible  bias  because  of  the  environment  from 
which  it  was  taken.  Let's  take  a  dose  look  at  the  qame  it¬ 
self  and  its  good  and  oad  points/  and  consider  their  respec¬ 
tive  impacts  on  the  data. 

The  game  is  olayea  in  a  secure  lao.  This  lab  is  capable 
of  being  divided  up  iocn  three  smaller  areas /  or  command 
centers  (Blue/  Oranoe/  and  Umpire).  Each  area  has  one  color 
graphics  display  using  svmboloqy  similar  to  an  fJTDS  presen¬ 
tation.  The  teams  can  chance  the  scale  of  their  disolays  as 
well  as  select  which  items  (air-surface-subsurface- 
friendly-enemv-neutral-or  any  combination  thereof)  they 
oesire  to  have  displayed.  In  addition  to  the  graphics 
display/  each  area  hes  an  order  incut  CRT  and  a  status  board 
CRT  from  which  information  can  be  queried.  Other  stations 
are  available  in  each  area  tc  utilize  decision  aids  if 
available  and  desired.  T  ne  game  itself  is  time  variable  from 
real  time  to  l/6th  real  time.  Information/  interactions 
between  units/  and  displays  are  generated  in  one  game  minute 
intervals.  Life-like  time  delays  for  order  resDones  are 
built  into  the  or oar am /  along  with  equipment  failures  based 
on  the  mean  time  between  failures  listed  in  the  game's  data¬ 


base 


The  database  can  be  that  of  a  previously  run/  canned 


scenario?  or  the  user  can  create  Ms  own  scenario  and  data¬ 
base  (at  the  exrense  of  irany  tens  of  man-hours). 

There  are  sore  dovicus  advantages  to  using  the  WES  game 
for  collection  of  oata.  Since  it  is  run  in  a  secure  mode? 
classified?  reel  I i *e  databases  can  oe  used  by  participants? 
iraMno  the  evolution  more  realistic.  The  game  is  computer 
driven?  so  the  ns?:i  for  excessive  amounts  of  manua'J  umpiring 
and  battle  carnage  assessment  di saopears.The  program  has  the 
advertised  capability  of  reviewing  tie  game  with  graphics  as 
it  was  played  bv  saving  the  game  on  tape.  New  technology  of 
sensors  or  weapons  can  readily  be  created  in  the  database? 
ang  new  decision  aims  can  oe  utilized  in  the  command  _^areas 
to  evaluate  their  usefulness  to  the  decision  makers. 

y*ES  does  have  several  limitations  as  a  research  tool  for 
a  project  like  ours.  The  first  is  the  current  lack  of  real¬ 
istic?  o f f -t he-sne 1 f  scenarios.  The  force  capability  parame¬ 
ters  are  not  accurate?  end?  importantly?  force  composition 
always  favors  t  r  e  blue  sice.  Another  weakness  is  that  all 
communications  are  done  through  one  CRT  terminal?  so  there 
is  nothing  available  to  simulate  the  detrimental  effects  of 
multiple  lines  of  communications  (confusion?  redundant  or 
conflicting  reports).  The  amount  of  data  available  to  the 
dI avers  appears  to  be  more  than  would  be  considered  realis¬ 
tic?  and  it  is  certainly  more  centralized  and'  eas i  1  y  at t ai n- 
able  than  would  generally  be  the  case  in  a  tactical  environ¬ 
ment.  The  pressure  of  a  tactical  environment  does  not  exist. 
These  factors  all  combine  to  eliminate  some  of  the  pressure 


out  on  an  actual  command  center.  This  is  a  significant  prob¬ 
lem  since  it  maxes  the  concent  of  reliance  on  WES  as  a  sole 
data  source  for  t  i  me  or  workload  constrained  experimentation 
ouest i onabl e  . 

Aside  from  the  oame ' s  characteristic  limitations#  there- 
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are  other  problems  to  oe  encountered  in  this  new  facility  of 
simulation  techniaues.  With  any  new  testbed  like  the  C3  Lab# 
there  are  growing  oains.  It  has  t  a xen  time  to  resolve  inter- 
face  problems  between  the  NPS  Lab  and  the  host  game  comput¬ 
ers.  Hardware  problems  at  the  host  computers  have  caused 
planned  experimentation  to  be  cancelled.  Little  or  no  coor¬ 
dination  between  host  ano  users  has  been  evident  when  crypto 
card  removals  are  executed.  Most  host  computers  are  not  ca¬ 
pable  of  runnino  more  than  one  NES  game  at  a  time#  and  un¬ 
scheduled  entries  into  the  system  tend  to  slow  the  game  down 
intolerably.  Pre-emption  bv  hioher  authority  can  monopolize 
the  host  comou t er  for  periods  of  ud  to  a  week.  However# 
better  schedulino  and  coordination  will  eventually  evolve 
into  a  more  reliable  system,  or  so  it  is  hoped. 

C.  IMPORTANCE  OF  HUMAN  FACTORS  IN  C2 

The  human  factors  impact  on  a  C2  system  is  one  of  the 
least  discussed  and  investigated  areas  in  the  field.  The 
graduate  level  program  at  the  Naval  Postgraduate  School  is  a 
mixture  of  technical  courses  with  the  addition  of  some  Na¬ 
tional  Security  Affairs  courses.  Ihe  only  insight  into  human 


factors  was  obtained  durino  our  study  of  computer  graphics, 
where  we  learned  how  to  m axe  graphics  more  attractive  and 
oleasina  to  the  human  eve.  Since  the  curriculum  was  generat- 
ed  with  the  advice  and  consent  of  the  best  C 2  minds  in  the 
nation.  it  is  safe  to  sav  that  they  are  more  concerned  with 
the  technical  aspects  of  tne  field.  what  I  find  annoying 
about  this  is  that  since  a  C2  system  is  designed  around  a 
decision  maker  (read  human  being).  I .  as  a  graduate  level 
exoert  in  the  field,  have  little  or  no  concept  outside  of 
fleet  tactical  experience  of  how  a  human  in  the  system  will 
react  in  various  situations. 

This  thesis  was  undertaken  in  an  attemDt  to  observe  and 
analyze  how  some  numan  operators  actually  behaved  in  a  com¬ 
mand  center  (an  area  in  which  I  had  some  experience). 
Although  there  were  several  reference  sources  available  (see 
bi bl i ograohy ) .  they  were  for  the  most  oart  vague.  general, 
ana  as  a  whole  not  very  instructive.  Bv  takirg  graphically 
oortrayed  and  exoe r i men t a  1 1 v  related  i nf ormat . on  on  loading 
ana  relevancv  ana  combinina  them  with  my  own  conceots  of 
data  availablity,  I  set  uc  an  alcorithm  to  analyze  these 
three  major  variables.  Although  the  data  source  was  not 
comorehens  i  ve  (as  discussed  in  b’ES  as  a  data  source)  I  pro¬ 
fited  from  the  admittedly  incomolete  and  Dreliminary  study 
of  human  reactions  that  has  been  described  here. 

Human  factors  research  in  the  C2  context  needs  to  be 
oursued  with  mere  vigor.  Although  he  is  not  as  glamorous  as 
creating  new  hardware  for  C2  architecture.  the  man-in-the- 
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1 ood  should  not  oe  overlooked.  Considering  human  needs  and 
frailties  could  save  many  headaches  and  dollars  in  the  long 
run.  It  is  important  to  remember  that  all  the  communications 
devices/  disolavs/  and  their  i  nt  e  's/aces  /  plus  various  deci- 
sion  aids  are  finally  in  the  service  of  a  human  decision 
Taker  with  human  capacities  and  human  -frailties. 

D.  SUMMARY 
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cannot  make  any  broader  statement.  There  was  a  potential 
weakness  in  the  data  in  that  it  was  composed  entirely  of 
subjective  inou’.s  being  related  to  objective  inputs.  After 
subjective  and  objective  inputs  have  been  correlated  the 
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process  and  model  should  be  able  to  make  more  definitive 
statements  and  reach  broader  conclusions.  We  have  carried 
out  a  pilot  study  toward  that  goal. 

This  work  offers  several  items  tD  the  reader.  A  general 
descriotion  and  model  of  a  C2  svstem  have  been  provided. 
Some  insipnts  are  aainea  into  individual  human  factors  and 
the  oroblems  encountered  when  attemoting  to  do  research  on 
them.  Potential  oitfalls  of  dealina  with  human  factors*  sub¬ 
jective  incuts*  and  an  oversi mol i f i ed  environment  are  iden¬ 
tified.  Although  the  purpose  of  finding  a  solid  pattern  of 
interelationshios  between  the  variables  on  a  broad  scale 
could  not  be  accomol  i  sr.ed*  there  is  sufficient  merit  in  the 
work  to  warrant  consideration  of  experimental  redesign  and 


further  studies  in  this  area 
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